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Abstract 

In  this  paper  we  consider  models  for  noncausal  processes  consisting  of 
discrete-time  descriptor  dynamics  and  boundary  conditions  on  the  values  of  the 
process  at  the  two  ends  of  the  interval  on  which  the  process  is  defined.  We 
discuss  the  general  solution  and  well-posedness  of  systems  of  this  type  and 
then  apply  the  method  of  complementary  processes  to  obtain  a  specification  of 
the  optimal  smoother  in  terms  of  a  boundary-value  descriptor  Hamiltoniein 
system.  We  then  study  the  Implementation  of  the  optimal  smoother.  Motivated 
by  the  Hamiltonian  diagonal ization  results  for  non-descriptor  systems,  we  show 
how  the  descriptor  Ifemiltonian  dynamics  can  be  transformed  to  two  lower-order 
systems  by  the  use  of  transformation  matrices  involving  the  solution  of  two 
generalized  Riccati  equations.  We  present  several  examples  illustrating  our 
results  and  the  nature  of  the  smoothing  solution  and  also  present  equations 
for  covariance  analysis  of  boundary-value  descriptor  processes  including  the 
smoothing  error. 
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I.  Introduction 

The  class  of  descriptor  systems  was  introduced  by  Luenberger  [1]  to 
describe  the  dynamics  of  certain  linear  systems  for  which  standard  state  space 
representations  are  not  particularly  natural  or  appropriate.  Since  their 
introduction  numerous  studies  have  been  performed  to  investigate  the 
properties  of  these  systems  and  the  solution  of  control  problems  for  them 
(see,  for  example,  [2]  -  [9],  [20],  [21]  and  the  references  cited  therein). 

The  fundamental  property  that  all  of  these  studies  have  had  to  deal  with,  in 
some  form  or  another,  is  the  fact  that  the  system  function  matrix  for  such  a 
system  is  not  proper,  leading  to  impulsive  behavior  in  continuous- time  and 
giving  rise  to  noncausal  responses  in  discrete-time.  The  noncausality  of 
these  models  makes  them  a  natural  choice  for  modeling  spatially  (rather  than 
temporally-) varying  phenomena,  and  in  this  context  it  is  natural  to  consider 
descriptor  models  with  general  boundary  conditions  rather  than  with  initial 
conditions  or  the  special  constrained  forms  for  boundary  conditions  found  in 
the  literature.  Indeed,  if  one  considers  generalizations  of  descriptor  models 
to  more  than  one  independent  variable,  one  finds  that  these  models,  together 
with  appropriate  boundary  conditions,  arise  in  many  contexts  such  as  in 
describing  random  fields,  electromagnetic  problems,  gravitational  anomalies, 
etc. 

The  investigation  of  standard  (i.e.  not  descriptor)  boundary-value  models 
in  one  independent  continuous  variable  was  initiated  by  Krener  [12]  -  [14]  who 
has  investigated  many  of  their  fundamental  properties.  Adams,  et  al.  [10] 
developed  a  general  approach  to  estimation  for  boundary- value  models  and 


3 


applied  it  in  [11]  to  develop  efficient  estimation  algorithms  for  processes 
described  by  the  model  introduced  by  Krener.  In  this  paper  we  extend  our 
estimation  methodology  to  two-point  boundary-value  descriptor  systems 
(TPBVBS’s),  i.e.  discrete-time  descriptor  models  in  one  independent  variable 
and  with  general  boundary  conditions.  To  our  knowledge  this  represents  the 
first  study  of  descriptor  models  devoted  to  estimation,  and  as  we  will  see, 
our  analysis  xmcovers  both  some  important  similarities  and  differences  with 
estimation  problems  for  standard  state  space  models  and  several  important 
problems  whose  solutions  remain  for  the  future.  These  questions  have  in  fact 
inspired  the  development  of  a  system  theory  for  TPBVDS’s  [25,29-31],  several 
elements  of  which  will  be  used  in  the  present  development.  Furthermore  .  in 
another  paper  [15]  we  use  the  results  developed  here  in  our  investigation  of 
efficient  estimation  algorithms  for  random  fields  describable  in  terms  of  a 
particular  class  of  boundary-value  descriptor  systems  in  two-independent 
variables. 

In  the  next  section  we  Introduce  the  class  of  TPBVDS’s  and  perform  some 
preliminary  analysis.  In  particular,  we  discuss  the  well-posedness  of  such  a 
system  and  a  general  method  of  solution  for  TPBVDS’s.  In  Section  III  we  apply 
the  results  of  [10,26]  to  the  fixed-interval  smoothing  problem  for  an 
nth-order  TPBVDS.  As  we  show,  aside  from  a  boundary  effect  which  can  be  dealt 
with  separately,  the  resulting  smoother  is  itself  naturally  described  as 
TPBVDS,  in  this  case  of  dimension  2n.  In  Section  IV  we  address  the  question 
of  implementation  of  the  smoother.  Motivated  by  the  "Hamiltonian 
diagonalization”  results  in  [11,22]  for  non-descriptor  systems,  we  investigate 
two  procedures  for  forward-backward  diagonalization  of  the  smoother  equations. 
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These  procedures,  which  are  illustrated  in  Section  V,  point  out  connections 
with  other  work  on  descriptor  systems  and  also  lead  to  a  number  of  additional 
questions  related  to  generalizations  of  causal  system- theoretic  concepts  to 
TPBVDS’s.  These  are  briefly  discussed  in  Section  VII  following  our  analysis 
of  the  smoothing  error  in  Section  VI. 
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II.  Two-Point  Boundary-Value  Descriptor  Systems 

The  TPBVDS  considered  in  this  pap>er  satisfies  the  difference  equation 
Ex(k+1)  =  Ax{k)  +  Bu(k)  (2.1) 


with  the  two-point  boundary  condition 

VqX(O)  +  Vj^(K)  =  V  (2.2) 

Here  u(k)  is  an  mxl  input  sequence  defined  on  the  discrete-time  interval 
[0.  k-1],  x(k)  is  the  n-dimensional  boundary  value  process,  v  is  the  n-vector 
of  botundary  values,  and  E,  A,  B,  Vq,  and  Vj^  are  matrices  of  appropriate 
dimensions.  Furthermore  we  assume  that  {E,  A}  form  a  regular  pencil  (i.e. 
|zE-A|  =  0). 

As  in  [2],  we  can  rewrite  (2.1).  (2.2)  as  a  single  set  of  equations 


ifx  =  3Su 

where 

x‘  =  (x'(0)....x’(K)) 

u'  =  (u'(0),....u’(K-l).v’) 


(2.3) 


(2.4a) 

(2.4b) 


(2.5a) 


=  diag  (B . B.  I) 


(2.5b) 


We  see  from  this  immediately  that  the  well-posedness  of  (2.1),  (2.2)  is 
equivalent  to  the  Inver tibility  of  if.  Much  more  can  be  said  about 
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well-posedness  and  the  solution  of  (2.1),  (2.2),  and  we  refer  the  reader  to 
[25,29]  for  details.  We  limit  ourselves  here  to  describing  one  method  for 
solving  (2.1),  (2.2)  that  provides  us  with  an  alternate  well-posdness 
condition  and  with  a  method  for  the  implementation  of  the  smoother  developed 
in  Sections  III  and  IV. 

To  begin,  from  Kronecker’s  canonical  form  for  a  regular  pencil  [17]  we 
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can  find  nonsingular  matrices  T  and  F  so  that 


(2.6) 


FAT 


0 

0  I 


(2.7) 


and  so  that  all  of  the  eigenvalues  of  A^  and  A^  have  magnitudes  no  larger  than 
1.  Furthermore  if  |zE-A|  has  no  zeros  on  the  unit  circle,  then  all  of  the 
eigenvalues  of  A^.  and  A^  are  strictly  Inside  the  unit  circle.  In  this  case  we 
will  say  that  {E,A}  is  forward-backward  stable. 


The  decomposition  in  [17]  splits  the  pencil  zE-A  into  forward  dynamics 
corresponding  to  a  pencil  of  the  form  zI-A^  and  backward  dynamics 

corresponding  to  z  where  A^  is  nilpotent.  The  only  difference  in  (2.6), 

(2.7)  is  that  the  unstable  forward  modes  of  A^  have  been  shifted  into  the 
backward  dynamics  A^. 


=  Tx(k) 


(2.8) 


Xf(k) 

_x^(k)_ 


(2.9a) 

(2.9b) 


Then,  we  obtain 

x^(k+l)  =  A^Xj(k)  +  Bj.u(k) 
Xj,(k)  =  A^x^(k+1)  -  B^u(k) 

where 


(2.10) 


and  (2.9a),  (2.9b)  are  assmiptotically  stable  recursions  if  {E,  A}  is 
forward-backward  stable.  Finally,  given  the  transformation  (2.8),  the 
boundary  condition  (2.2)  takes  the  form 


['^f,o:\,o] 


Xf(0) 

5^(0) 


(^f,K:\,K] 


Xf(K) 

Xb(K) 


=  V 


(^f,o:\,o]  "  V  ’  (^f,k:\,k]  ”  ^ 


(2.11) 

(2.12) 


Employing  the  forward/backward  representation  (2.9)  of  the  dynamics,  a 
general  solution  to  (2.1).  (2.2)  is  derived  as  follows.  Let  x^‘^(k)  denote  the 
solution  to  (2.9a)  with  zero  initial  condition,  and  let  3Cjj^(k)  denote  the 
solution  of  (2.9b)  with  zero  final  condition.  Then 
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x^(k)  =  A^x.^{0)  +  Xj^(k)  {2.13a) 

(2.13b) 


Substituting  (2.13)  into  (2.11)  and  solving  for  x^(0)  and  Xjj(K)  yields 


(•  ■ 

Xf(0) 

K(K) 


=  H-l{v  -  Vj 


(2.14) 


where 

“  =  5.o"''f,K*f'‘;''b.o\X,K]  =  VoT-^FEr-')"  V^T-lcFAT-')" 

(2.15) 


Finally,  substituting  (2.14)  into  (2.13)  we  obtain 


x^(k) 

Aj^  0 

„-l  r  ,  0-  .  0 

On  ^ 

X.  (k) 

yk) 

0  A^-k 

«  -  ''b.o’S  * 

A 

Xb°(k) 

(2.16) 


The  solution  in  the  original  basis  can  then  be  obtained  by  inverting  (2.8). 

Assuming  that  (E,  A)  is  forward-backward  stable,  the  solution  procedure 
is  just  described  consists  of  stable,  forward/backward  recursive  computations 
for  Xj^.  x^,  followed  by  the  correction  for  the  actual  boundary  conditions 
given  by  the  first  term  on  the  right-hand  side  of  (2.16).  Note  also  that  this 
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procedure  also  provides  us  with  another  necessary  and  sufficient  condition  for 
the  well-posedness  of  (2.1).  (2.2),  namely  the  invertibility  of  H  in  (2.15). 
This  condition  is  the  analog  of  that  described  by  Krener  [12]  -  [14]  for 
standard  boundary-value  problems.  Note  that,  as  one  would  expect,  not  all 
choices  of  boundary  conditions  lead  to  well-posed  problems,  and  the  conditions 
that  Vq  and  Vj^  must  satisfy  depend  heavily  on  the  structure  of  E  and  A.  For 
example,  as  is  well  known,  the  initial  value  problem  (Vq  =  I,  =  0)  is  not 
well-posed  if  E  is  singular.  This  can  easily  be  seen  from  (2.15)  or  from 
(2.5a),  since  the  last  block  of  columns  then  is  not  of  full  rank. 
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III.  The  Optimal  Smoother 

Consider  now  a  stochastic  process  x{k)  satisfying  (2.1),  (2.2)  (which  we 
assume  is  well-posed)  where  u(k)  eind  v  are  independent,  zero  mean  and 
Gaussian,  v  has  covariance  and  u(k)  is  a  white  sequence  with  covariance  Q. 
In  this  section  we  examine  the  estimation  of  x(k)  given  the  interior 
observations 

y(k)  =  Cx(k)  +  r(k),  k  e  [1,  K-1]  (3.1) 

and  the  boundary  measurements 

yb  =  WqX(O)  +  Wj^(K)  +  r^^  (3.2) 

Here  r(k),  r^,  u(^),  and  v  are  mutually  independent,  is  zero  mean  Gaussian 
with  covariance  IT^,  and  r(k)  is  zero  mean,  Gteiussian,  and  white  with  covariance 
R. 


In  order  to  derive  the  optimal  smoother,  we  introduce  notation  analogous 


to  (2.4).  (2.5) 


y  =  ‘fix  +  r 

where 


y'  =  [y'(i).  y’(2) . y‘(K-i).  y^-] 

r-  =  [r'(l),  r'(2) . r-(K-l).  r^'] 


<€ 


b  c  0 
0  0  c 


0 

% 


0 


0 

0 


0 

0 


0  0  ' 
:  0 

c  0 

0  wj 


(3.3) 


(3.4a) 

(3.4b) 


(3.5) 
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Also,  the  covariances  of  u  in  (2.4b)  and  r  in  (3.4b)  are  given  by 

C  =  diag(Q . Q,  (3.6a) 

^  ss  diag  (R, . . .  ,R,  ITi^)  (3.6b) 

Our  problem,  then  is  to  estimate  x  given  y,  and  the  approach  we  adopt  is 
the  method  of  complementary  processes  introduced  in  [26]  and  elaborated  upon 
in  [10,11].  Specifically,  suppose  that  we  can  construct  a  random  vector  z 
that  is  complementary  to  y  in  the  sense  that  (i)  it  is  independent  of  y  and 
(ii)  the  transformation  from  (u,r)  to  (y,z)  is  linear  and  invertible.  Then  we 
can  write  x  explicitly  as  a  linear  function  of  y  and  z,  euid,  thanks  to  (i)  can 

As. 

obtain  x  simply  by  setting  z  to  zero.  In  the  present  context,  since  x  is 
specified  implicitly  by  (2.3),  we  also  obtain  and  implicit  representation  for 
z.  Specifically,  as  we  verify  below,  z  is  given  by  the  following 

=  <€'9J"^r  (3.7) 

z  =  -S8'X  +  e“^u  (3.8) 

where 

X*  =  [X’(l) . X’(K),X'(0)]  (3.8) 

(the  reason  for  our  particular  choice  of  labeling  of  components  in  (3.8)  will 
be  made  clear  shortly).  Note  that  (3.7)  also  has  an  interpretation  as  a 
TPBVDS,  but  we  defer  discussion  of  this  until  our  related  discussion  of  the 
smoother  itself. 

As  a  first  step  in  verifying  (3.7),  (3.8)  note  that  (3.7)  is  well-posed 
since  if'  is  invertible.  Next  note  that  the  independence  of  y  and  z  can  be 
obtained  by  direct  computation: 

E{yz'}  =  E{[‘€y’~^3ki  +  r][-26’ (if  *  )“^‘e'C^r  +  e“^u]  '  } 

=  =  0 


(3.9) 
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We  next  show  that  we  can  compute  x  and  X  from  y  and  z.  Specifically,  using 
(3.8)  to  eliminate  u  and  (3.3)  to  eliminate  r,  we  find  that  (2.1),  (3.7)  are 
equivalent  to 


'  if  -S5CSS' 


X 

'sSCz 

.X. 

(3.10) 


The  matrix  on  the  left-hand  side  of  (3.10)  can  be  shown  to  be  invertible  as 
follows.  Since  if  is  invertible,  we  need  only  show  that  the  Schur  complement 
D  =  y  +  (3.11) 

is  invertible.  Note  that 

0(5/”  )"^  =  I  +  ML  (3.12) 

where  M  =  ^*6  >  0  and  L  =  if  ^?kCl$'{if')  ^  >  0.  The  invertibility  of  D  then 

0 

follows  from  the  fact  that  ML  cannot  have  negative  eigenvalues.  Finally,  once 
we  have  recovered  x  and  X  from  y  and  z,  u  and  r  can  be  obtained  from  (3.8)  and 
(3.3),  respectively. 

Next,  by  setting  z  to  zero  in  (3.10)  we  obtain  the  implicit  equations 

.A 

defining  the  optimal  smoothed  estimate  x: 


■  if 

X 

■  0  ■ 

if' 

A>. 

X. 

(3.13) 


Suppose  MLv  =  Xv. 


Then  v'L'MLv  =  Xv'L'v,  so  that  X  =  (v'L’MLv'/(v'L’v)  >  0. 
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This  again  defines  a  well-posed  TPBVDS,  but  to  obtain  the  most  illuminating 
form  of  this  system  requires  a  permutation  of  the  equations  and  variables  in 
(3.13).  Specifically,  it  is  straightforward  to  verify  that  (3.13)  is 
equivalent  to 

H  =  V  (3.14) 

where 

S'  =  C(X‘(0).  V(0)).  (x*(l).  X'(l)) . (x’(K).V(K))]  (3.15a) 


T)  = 


0 


0 


0 


"o'V^  ’  cR'Vd) 


0 


C'R"V(K-1)  , 


(3.15b) 


?  = 


^11 

0 

0 

0 

■^21 


S  0  .  .0 . 0 

-d  S  0  . 0  0 

0  -d  S  . 0  0 

0  0  0  -d  S 

0  0  0 . 


(3.16) 


with 


E 

-BOB’’ 

A 

0  ■ 

s  = 

.0 

-A’ 

.  d  = 

.-C'R“^C 

-E’. 

f-A 

0 

f 

•'ll  = 


*o'V‘»o  ''o’ 


■f  = 
■  ^12 


0 


0 


Vb  \  0 


(3.17) 


(3.18a) 


'’o 

-n 

V 

''k 

0  ' 

II 

*k’V\ 

V  ’ 

K  J 

II 

<M 

y^\ 

E' 

(3.18b) 
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Comparing  the  form  of  ^  In  (3.16)  to  that  of  in  (2.3),  we  see  that 

(3.14)  is  almost  a  standard  TPBVDS  except  for  the  top  row  of  equations  -  i.e. 

the  fact  that  in  (3.16)  appears  rather  than  ~d  and  that  present  at 

all.  This  is  a  consequence  of  the  discrete  nature  of  the  time  index  and  the 

7 

intrinsic  asymmetry  of  the  model  (2.1),  (2.2).  We  can,  however,  reduce  these 
equations  to  a  standard  TPBVDS  by  means  of  a  basic  technique  in  the  analysis 
of  boundary-value  systems  [14,25,29,30].  Specifically,  we  can  think  of  (3.14) 

/V  A* 

as  a  TPBVDS  with  boundary  values  consisting  of  (x'(0),  X'(0))'  and  (x'(K), 

/V 

X'(K))'.  Because  of  the  well-posedness  of  (3.14)  it  is  possible  to  eliminate 
some  of  the  variables  from  (3.14)  by  solving  for  them  in  terms  of  the 
remaining  variables.  More  specifically,  it  is  possible  to  move  the  boundary 
values  inward  by  eliminating  boundary  values  at  one  end  of  the  interval,  the 
other,  or  both.  One  can  iterate  this  process,  and  in  fact  this  type  of 
recursion  forms  the  basis  for  a  notion  of  state  for  boundary  value  systems 
[14,25,29,30].  For  our  purposes  here,  however,  we  need  only  consider  a  single 
step  of  this  type. 
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Note  that  u(k)  is  defined  on  [0,  K-1],  while  x(k)  is  defined  on  [0,K]. 
Referring  to  [10],  it  is  not  possible  in  the  discrete  index  case  to  define  the 
domain  on  which  x  and  u  are  defined  and  the  boundary  of  that  domain  so  that 
either  the  boundary  is  contained  in  or  disjoint  from  the  domain. 


Specifically,  the  invertibility  of  ?  implies  that 


has  full  column  rank  and  thus  that  we  can  eliminate  (x' (0) ,X(0)) '  as  follows. 
We  construct  matrices  and  such  that  has  full  row  rank  and 


[M^.  M2] 


=  0 


(3.19) 


If  we  then  premultiply  (3.14)  by  the  following  full-rank  matrix 


we  obtain  a  TPBVDS  of  a  form  exactly  as  in  (2.1),  (2.2).  Specifically,  this 
computation  yields 


]  f  0  ' 

x(k+l)  x(k)  ^ 

£  ^  =  s4  ^  +  ,  .  k=l . K-1  (3.20) 

X(k+1)  X(k)  C‘R  y(k) 

•  ^  V  J  Vi  • 


with  boundary  conditions 
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'x(l)' 

Ml). 


^22^ 


■x(K)' 

.MK). 


0 

0 

=  «1 

^”2 

*K'V'yb 

(3.21) 


By  construction  we  know  that  this  system  is  well-posed.  Also,  once  we  have 
computed  x(k) ,  X(k) ,  k=l . K,  we  can  determine  the  previously  eliminated 

4<N  /V 

boundary  values  x(0) ,  X{0) : 


MO)- 

0 

0 

.X{0). 

-  D 
"  ^11 

^■^21' 

W„'ff  "Vu 

'■  K  b  •'b'' 

•x{l)- 

.X(l). 


-  [-t 


11*^12 


"*^21  ”*^22^ 


■x(K)' 

.X(K). 


{3.22a) 


where 


D  =  +  “<'21  "^21]  ^  {3.22b) 

As  a  final  comment,  we  note  that  on  examination  of  (3.20),  (3.21)  and  the 
form  of  ^  and  d  in  (3.17),  we  see  that  what  we  have  derived  is  a 
generalization  of  the  Hamiltonian  form  of  the  optimal  smoother  for  causal 
systems  {see,  e.g.  [11,22]).  This  Immediately  suggests  the  possibility  of 
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generalizing  methods  for  solving  smoothing  equations  such  as  diagonal ization 
of  the  Hamiltonian  dynamics  [11,22]  to  produce  forward  and  backward 
recursions.  Such  an  approach  is  described  in  the  next  section. 
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IV.  Implementation  of  the  Smoother 

In  this  section  we  discuss  several  approaches  to  solving  the  smoothing 
TPBVDS  (3.20),  (3.21).  One  obvious  method  of  solution  is  the  direct 
application  of  the  method  described  in  Section  2  for  solving  general  TPBVDS’ s. 
The  question  that  then  arises  is  the  construction  of  the  similarity 
transformations  that  block-diagonal ize  S  and  d  as  in  (2.6),  (2.7).  One 
obvious  answer  to  this  is  to  use  the  general  procedure  in  [17]  for  the 
computation  of  the  Kronecher  form  of  (i.d).  A  second  is  to  consider 
generalizations  of  Hamiltonian  diagonal izatlon  procedures,  which  are  developed 
in  the  following  two  subsections.  In  the  first  of  these  we  closely  parallel 
the  approach  used  for  non-descriptor  systems  and  are  led  to  descriptor  Riccati 
equations  and  decoupled  descriptor  dynamics.  As  we  will  see,  this  approach 
does  not  always  work,  and  this  leads  us  to  an  alternative  approach  in  Section 
4.2  Involving  a  different  type  of  generalized  Riccati  equation  and  producing 
decoupled  non-descriptor  dynamics.  As  we  discuss  in  this  and  in  subsequent 
sections,  this  approach  points  the  way  to  developing  the  relationship  between 
system  -  theoretic  concepts  such  as  reachability  and  observability  and 
properties  and  eigenstructure  of  the  smoother. 

4.1  Hamiltonian  Diagonal ization:  Method  1 

The  general  concept  of  Hamiltonian  diagonal ization  is  as  follows.  We 
seek  two  sequences  of  matrices,  M(k)  eind  N(k)  so  that 
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fEf(k)  0 

M(k)«N"^(k+l)  =  (4.1) 

0  A^{k) 

and 

[AfCk)  0 

M(k)gN"^(k)  =  (4.2) 

0  E^(k) 

In  this  case  the  2n-dlmenslonal  descriptor  d3mamics  of  (3.20)  can  be  decoupled 
into  two  n-dimensional  descriptor  systems  (coupled,  of  course,  through  the 
boundary  conditions). 

The  choice  of  the  sequences  M(k)  and  N(k)  is  far  from  unique,  and  the 
general  algebraic  equations  that  the  nxn  blocks  of  M(k)  and  N(k)  must  satisfy 
are  presented  in  [18]  and  [19].  In  this  subsection  we  present  one  choice  that 
is  the  direct  counterpart  of  the  method  used  in  [11]  for  non-descriptor 
continuous-time  boundary  value  processes  and  that  involves  descriptor  Riccati 
equations  that  have  appeared  elsewhere  in  the  literature.  Specifically, 
suppose  that  P(k)  euid  0(k)  are  invertible  matrix  sequences  satisfying, 
respectively,  the  following  forward  and  backward  descriptor  Riccati 
recursions : 

EP(k+l)E'  =  A[P“^(k)  +  C'R“^C]“^A'  +  BQB'  (4.3) 

E’e(k)E  =  A‘[0“^(k+1)  +  BQB']“^A  +  C'R"^C  (4.4) 

In  the  case  of  causal  systems  (with  E  =  I),  (4.3)  is  the  recursion  satisfied 
by  the  one-step  forward  prediction  error  variance,  while  (4.4)  is  the 
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8 

recursion  satisfied  by  the  inverse  of  the  backward  filtered  error  variance. 
Also,  define 

Z(k)  =  E'e{k)E  +  P"^{k)  (4.5) 

In  the  causal  case  and  with  appropriate  choices  of  initial  condition  for  P(k) 
and  final  condition  for  0(k) .  Z(k)  is  the  inverse  of  the  smoothing  error 
variance. 

Def ine 


M(k) 


I  : 

A[P  ^(k)+C’R  C]  1 

Z“^(k)A'[  0"^(k+l)+BQB']~^  • 

I 

N 

1  1 

1 

. 

1 

(4.6) 


N  ^(k) 


■z"^(k)  P{k)E'' 

-  e(k)EZ“^(k)  I 


{4.7) 


Some  algebraic  manipulations  verify  that  M(k)  and  N{k)  are  invertible  if  P(k) , 
0(k),  and  Z{k)  are,  and  if  we  perform  the  computations  involved  in  (4.1), 

(4.2)  and  define 


■f(k)l  A 

=  N(k) 

.T?(k). 


'x(k)- 

.Mk). 


(4.8) 


8  “1 

The  actual  quantities  P(k)  and  0  (k)  have  these  interpretations  only  if  the 

initial  and  final  conditions  P(0)  and  0(K)  are  appropriately  chosen.  In  this 

case  [P  ^(k)  +  C’R  ^C]  ^  is  the  forward  filtered  error  covariance,  while 
-1 

0  (K)  +BQB'  is  the  one-step  backward  prediction  error  covariance. 
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the  smoother  dynamics  (3.20)  decouple  into 

EP(k+l)f{k+l)  =  A[P"^(k)+C’R"^C]"^  [f(k)+C‘R"V(k)]  (4.9) 

P{k)E'Tj{k)  =  [P~^(k)+C’R"^C]"U’p(k+l)+Z”^(k)C'R"V(k)  (4.10) 

The  boundary  conditions  in  the  transformed  coordinates  can  be  determined  from 
(3.21),  (3.10),  and  (3.12). 

As  a  simpler  alternative  one  might  consider  consteint  transformations  M 
and  N  as  in  (4.6)  and  (4.7),  but  using  solutions  to  the  steady-state 


descriptor  Riccati  equations 

EPE'  =  A[P“^+C’R"^C]“^A'  +  BOB’  (4.11) 

E'  0  E  =  A'[  0  +  BQB’]"^A  +  C'R~^C  (4.12) 

Note  that  in  this  case  the  transformed  smoother  dynamics 

EPf(k+l)  =  A[P~^+C’R"^C]~^  [f(k)+C'R~V(k)]  (4.13a) 

PE'T7(k)  =  [P“^+C'R“^C]“^A’T7(k+l)+Z"^C'R"V(k)  (4.13b) 


“  _i  _i  _i 

Involves  two  pencils  (E^.A^)  =  (EP,  A[P  +C'R  C]  }  and  (Eg.Ag)  = 

-1  -1  -1 

{PE*,  [P  +C'R  C]  A'}  that  are  transposes  of  one  another.  In  this  case  if 
we  follow  the  solution  procedure  outlined  in  Section  2.1,  if  the  matrices 
euid  Tj  transform  {Ej,Aj}  into  the  form  shown  in  (2.6),  (2.7),  then  ^^2  “  ^1 ' 
and  ^2  =  Fj '  do  the  same  for  {Eg.Ag}- 

The  descriptor  Riccati  equations  we  have  introduced  have  appeared  in  the 
literature.  In  the  case  in  which  E  is  nonsingular,  which  was  studied  by  Laub 
in  [24],  it  is  clear  that  these  are  no  difficulties  in  solving  (4.3),  (4.4)  or 
equivalent  versions  not  involving  inversions  of  P  and  0)  nor  in  obtaining 
controllability  and  observability  conditions  under  which  (4.11),  (4.12)  have 
unique  positive  definite  solutions.  Furthermore  in  this  case  it  is  also 
possible  to  i>arallel  the  approach  in  [11]  (for  the  non-descriptor  case)  in 
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choosing  boundary  conditions  P(0)  and  0(K)  for  (4.3),  (4.4)  so  that  the 
boundary  conditions  associated  with  (4.10)  are  minimally  coupled.  Similarly, 
in  the  case  in  which  A  is  invertible,  we  can  do  something  analogous,  leading 
to  a  p>air  of  dual  Riccati  equations,  essentially  by  reversing  time  (k  -*  K-k) 
thereby  interchanging  the  roles  of  A  and  E.  While  the  approach  outlined  in 

9 

this  section  (or  its  dual)  works  when  either  A  or  E  is  Invertible,  the 
difficulty  arises  when  both  E  and  A  are  singular.  As  pointed  out  by  Bender, 
singularity  can  cause  equations  such  as  (4.3)  to  fail  to  have  solutions  for 
particular  initial  conditions.  Also,  as  we  illustrate  through  an  example  in 
the  next  section,  when  E  and  A  are  both  singular  (4.11).  (4.12)  have  solutions 
only  in  an  uninteresting  case.  What  is  therefore  required  is  a  different 
approach.  Previous  studies  of  control  problems  for  continuous  or  discrete 
descriptor  systems  [9],  [21],  [23]  have  circumvented  this  difficulty  by 
deriving  and  dealing  with  lower-order  standard  Riccati  equations  (of  dimension 
equal  to  the  rank  of  E).  In  our  case,  however,  we  are  Interested  in 
diagonalizing  the  Hamiltonian  dynamics.  As  we  develop  in  the  next  section, 
this  is  possible  if  we  Introduce  equations  that  are  not  quite  standard  Riccati 
equations  but  are  far  closer  to  them  than  (4.11),  (4.12). 
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Note  that  S  and  d  are  both  singular  if  either  E  or  A  is,  so  that  the 
procedure  in  this  section  does  work  on  a  class  of  nontrivial  Hamiltonian 
descriptor  dynamics.  See  [27],  [28]  for  investigations  of  discrete-time 
algebraic  Riccati  equations  by  examination  of  the  pencil  defined  by  &  and  d 
when  E  =  I. 


4.2  Hamiltonian  Diagonal imt ion:  Method  2 


In  this  subsection  we  focus  completely  on  time- invariant  versions  of  the 
transformations  (4.1),  (4.2).  The  key  to  the  transformations  are  the 


generalized  Riccati  equations 

0  =  A'(E0"^E'  +  BC3B')"^A  +  C'R'^C 
=  A(E'\f~^E  +  C'R“^C)"^A'  +  BOB’ 


(4.14) 

(4.15) 


Note  that  these  equations  are  "almost"  standard  Riccati  equations,  except  for 
the  presence  of  E  and  E'  multiplying  0  ^  and  ^  in  the  terms  in  parentheses. 
While  there  appears  to  be  some  asymmetry  in  the  roles  played  by  E  and  A,  this 
is  an  illusion,  as  can  be  seen  by  introducing  an  additional  pair  of  matrices. 


specifically,  if  we  define 
S  =  E0“^E'  +  BOB* 


we  see  that 

0  =  A’S“^A  +  C*R“^C 


Similarly,  by  introducing 
T  =  E'4>“^E  +  C’R“^C 


we  obtain 

=  AT"^A'  +  BOB’ 


(4.16a) 


(4. 16b) 


(4.17a) 


(4.17b) 


Consequently,  we  can  view  (4.16)  and  (4.17)  individually  as  pairs  of  equations 
to  be  solving  for  (S,0)  and  (T,4'),  respectively.  We  assume  throughout  this 
section  that  positive  definite  solutions  for  these  four  quantities  exist.  As 
in  the  previous  section,  if  either  E  or  A  is  invertible,  we  can  reduce  these 
equations  to  standard  Riccati  equations  and  therefore  can  obtain  the  usual 
type  of  reachability  and  observability  conditions  for  existence  of  such 
solutions.  Also,  as  we  illustrate  in  the  next  section  these  equations  admit 
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positive  definite  solutions  even  in  cases  in  which  both  E  and  A  are  singular. 
General  conditions  for  existence  and  uniqueness  of  positive  definite  solutions 
and  relationships  with  the  notions  of  reachability  and  observability  for 
TPBVBS’s  will  be  described  in  a  future  paper  [33]  {See  Section  VII  and  also 
[32]  for  a  sketch  of  the  basic  results). 

Consider  next  the  matrices 

r  -l-i 

I  AT 

M  =  (4.18a) 

A'S  ^  -I  J 

E  ' 

N  =  (4.18b) 

0  E’J 


The  invertibility  of  N  is  immediate  from  the  invertibility  of  0  sind  the 
invertibility  of  the  Schur  complement 
-  E0"^E’ 

Similarly  the  invertibility  of  M  follows  from  the  invertibility  of  -I  and  of 
the  Schur  complement 
I  +  A’S'^AT"^ 

(which  is  Invertible  since  T>0,  A'S^A>Oso  that  the  eigenvalues  of 
A’S  ^AT  ^  are  nonnegative). 

It  is  a  straightforward  exercise,  using  (4.16),  (4.17)  to  show  that 
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Therefore,  If  we  premultiply  (3.20)  by  M  and  make  the  chaise  of  coordinates 


r ^  r 


■5(k)' 

=  N 

■x(k)- 

A 

b{k)J 

LX(k)J 

(4.20) 


the  smoother  dynamics  are  transformed  into  standard  non-descriptor  recursions : 

6(k+l)  =  AT"^E’<l'"^6{k)  +  AT"^C‘R~V{k)  (4.21a) 

^(k)  =  A’S"4e~^^(k+l)  +  C’R"V{k)  (4.21b) 

with  boundary  conditions 


-1 

■6(1)' 

_1 

5(K)' 

Mj«N  ^ 

.^(1). 

*  ^  V223'' 

•  • 

0 

+ 

■  • 

0 

V  J 

2 

.''K'V'^b 

(4.22) 


Note  that  (4.21)  consists  of  a  forward  recursion  (a)  and  a  reverse  recursion 
(b),  with  coupled  boundary  conditions  (4.22).  The  approach  outlined  in 
Section  II  (see  (2.13)  -  (2.16))  can  then  be  used  directly  to  obtain  the 

solution.  Once  this  is  accomplished,  we  can  recover  x(k)  and  X(k) ,  k=l . K 

by  Inverting  (4.20),  i.e.  from  the  relationship 
x(k)  =  [6  +  E’'J'"^E]"^[^(k)  +  E’^"^6(k)] 

Mk)  =  ^'“^ECe  +  E’«'“^E]"^i(k)  -  [>?  +  E0"^E*]~^6(k) 


(4.23a) 

(4.23b) 


and  then  can  recover  x(0),  X(0)  from  (3.22).  Note  that  since  one  is  generally 
interested  only  in  x.  it  is  only  necessary  to  compute  X(l)  and  A{K)  in  {4.23b) 
in  order  to  be  able  to  determine  x(0)  from  (3.22). 
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V.  Examples 

In  this  section  we  first  present  an  example  Illustrating  our  smoothing 
results  for  TPBVDS’s  and  then  introduce  the  class  of  cyclic  systems  in  a 
second  example. 

Example  5.1:  As  we  Indicated  in  the  previous  section,  the  case  in  which 
either  E  or  A  is  invertible  can  be  thought  of  as  a  slight  generalization  of 
the  causal  case  (perhaps  with  time  reversal),  and  consequently  both  of  the 
Riccati-like  methods  of  the  previous  section  (or  the  dual  of  the  method  of 
Section  4.1)  work  without  difficulty.  In  this  example,  we  look  at  a  system 
for  which  both  E  and  A  are  singular  and  first  illustrate  the  problems  with  the 
method  of  Section  4.1  and  the  apparent  superiority  of  the  approach  in  Section 
4.2. 

Consider  the  descriptor  system  with 


1  o' 

b  o' 

E  = 

A  = 

P  0. 

p  1. 

In  this  case  it  is  not  difficult  to  check  that  difficulties  arise  in  solving 
the  time-varying  descriptor  Rlccati  equations  (4.3),  (4.4)  or  their 
time-invariant  counterparts  (4.11),  (4.12).  For  example,  let 


^11 

p 

12 

-1 

Ull 

U12I 

.^12 

p 

^22j 

,  [P  ^  +  C'R  ^C]  = 

.''12 

.  % 

1  CM 

1  (N 

D 
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and  consider  (4. 14)  which  In  this  case  reduces  to 


'■n 

o' 

0 

0 

P 

0. 

p 

^22- 

+  BOB' 


which  Is  obviously  Inconsistent  with  a  positive  definite  solution  for  P.  Even 
If  one  considers  Indefinite  solutions,  we  see  that  none  can  possibly  exist  If 
BOB'  Is  not  diagonal.  Indeed  the  only  case  In  which  any  solutions  exist  to 
(4.11),  (4.12)  Is  when  BQB’s  eind  C'R  are  both  diagonal.  In  this  case  P  and 
0  are  also  diagonal,  with  the  positive  diagonal  element  corresponding  to  the 
error  covariance  of  the  causal  part  of  the  system  (the  first  state  component) 
and  the  negative  element  to  the  negative  of  the  error  covariance  of  the 
anticausal  (second  state)  component.  Furthermore,  the  diagonal  nature  of  BQB' 
and  C'R  implies  that  independent  noises  drive  each  component  and 
independent  observations  are  available  for  each  —  i.e.  the  problem  reduces  to 
the  trivial  and  uninteresting  case  of  two  completely  decoupled  systems. 

On  the  other  hand,  the  generalized  Riccatl  equations  (4.14),  (4.15)  admit 
solutions  in  nontrivial  cases.  For  example,  if 


l' 

o 

B  = 

Q  =  1. 

C  =  R  = 

.1. 

[o  ij 

the  solutions  to  (4. 14) ,  (4. 15)  are 


1 

o' 

1  1" 

0  = 

.  = 

p 

3. 

.1  2. 
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and 


'2  r 

3  o' 

s  = 

.  T  = 

.1  1. 

.0  1. 

This  example  also  illustrates  the  degeneracy  that  arises  in  the  dynamic 
portion  of  the  smoother  for  TPBVDS’s  whenever  either  E  or  A  is  singular. 
Indeed  in  this  case  (4.21)  reduces  to 


6{k+l)  = 


b 

p 


o' 

1. 


y{k) 


-rCk) 


■  0 
.-1 


0 

0. 


'r(k+l)  +  y(k) 


(5.1) 


(5.2) 


This  is  of  course  an  extreme  example,  since  the  two  components,  x^  and  x^,  of 
X  are  essentially  identical  white  noise  sequences  (with  a  sign  inversion  and  a 
one  unit  relative  time  shift)  except  for  the  possible  correlation  between  x(0) 
and  x(K)  Introduced  by  the  boundary  conditoins.  However,  while  in  general  the 
system  matrices  in  (4.21)  will  not  be  nilpotent  as  they  are  here,  there  will 
always  be  some  rank  deficiency  if  either  A  or  E  is  singular. 

Finally,  let  us  illustrate  the  rest  of  the  smoothing  solution  for  this 
exEimple.  Even  in  this  degenerate  case  the  one  time-step  delay  between  x^  and 
X2  and  the  nature  of  the  boundary  conditions  can  lead  to  a  nontrivial  form  for 
the  smoother.  In  jjarticular,  suppose  that 
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0  0 


(5.3) 


^0  = 


1  0 
0  1 
0  0 
0  0 


0  0 
0  0 
1  0 
0  1 


■  \  = 


(5.4) 


The  dynamics  plus  boundary  conditions  in  this  case  are 
Xj^(k+1)  =  u{k) 

k  =  1 _ ,K  -  1 

X2(k)  =  -u{k) 

with  ^2(0)  a  unit  variance  random  variable  independent  of  u.  and  with 
=  x^(0)  +  u{0) 

Referring  to  (3.18),  we  have 
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We  can  then  compute  Mj  and  satisfying  (3.19): 
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The  boundary  conditions  (4.22)  for  (5.1),  (5.2)  then  are 
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where 
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0 

-1 

^“2 

.  -1 

(5.5) 


Then  applying  (2.16)  to  (5.1),  (5.2),  (5.5)  (with  an  adjustment  for  the 
fact  that  the  smoother  (5.1),  (5.2)  runs  from  1,  rather  than  0,  to  K) ,  we  find 
that 
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2  <  k  <  K 
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0  0 

TCk)  =  y(k)  +  y(k-l).  1  <  k  <  K-2 

-1  0 


^  0  0  0  0 
"tCK-I)  =  a  +  y(K-l) 

0-100 


0  10  0 


=6_„  159l“^6_„ 

11  ^  11  11  11  ^ 


0  0 


Finally,  using  (4.23)  we  compute 


2  -11  . 


f  {-rCk)  +  6{k)} 

0  0 


I  0 


i-i  “J 


2  -1 


-1  2 


and,  from  (3.22) 


x(0)  = 


i_  i 

32  “8 
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where 
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"■^21* 

^0  ®b  ^b 

L  K  b  •'bj 

Example  5.2:  In  this  example  we  introduce  the  class  of  cyclic  TPBVDS’s  for 
which  the  boundary  condition  (2.2)  takes  the  special  form 
x(0)  =  x(K) 

Equivalently  we  can  think  of  a  cyclic  system  as  being  defined  on  [0,  K-1]  with 
the  boundary  condition 


Ex{0)  -  Ax{K-l)  =  Bu{K-l) 

(so  that  y  in  (2.5a)  is  block-circulant) . 

Consider  the  smoothing  problem  for  such  a  system  when  the  boundary 
measurements  are 


=  Cx(0)  +  r^ 


with  U,  =  R.  it  is  not  difficult  to  check  that  in  this  case  ^  is  also 
b 


block-circulant  (i.e. 


■^22  =  "^12  ~  ^21  ~  that  the  smoother 

is  also  a  cyclic  TPBVDS  over  [0,  K-1]  (with  no  need  to  move  the  boundary  in 
one  step  as  in  (3.19)  -  (3.22)).  If  we  then  follow  the  procedure  described  in 
Section  4.2,  we  obtain  two  non-descriptor  cyclic  systems 


6(k+l)  =  Fg6(k)  +  Ggy(k)  .  6(0)  =  6(K)  (5.6) 


'r(k)  =  F^'r(k+1)  +  G^y(k)  .  'r(O)  =  Tr(K)  (5.7) 

where  the  F’s  and  G’s  are  specified  in  (4.21)  and  we  have  adopted  the  notation 
y(0)  =  y(K)  =  y^. 
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Obviously  the  symmetry  of  the  cyclic  case  leads  to  some  simplifications. 

In  fact,  note  that  the  two  systems  (5.6),  (5.7),  includir®  boundary 

conditions,  are  completely  decoupled.  This  greatly  simplifies  their  solution, 

which  we  can  write  as  cyclic  convolutions: 

K-1 

6(k)  =  I  F/Ggy(k-«-l)  (5.8) 

i=0 

k=0,l _ ,K-1 

K-1 

^{k)  =  [I-F^*^]"^  I  F^\y(k+«)  (5.9) 

e=o 

where  we  extend  y(k)  periodically  (i.e.  y(k+K)  =  y(k)).  The  estimate  x(k)  can 

/N 

then  be  computed  from  (4.23a)  again  without  any  need  to  determine  x(0) 
separately  since  we  did  not  need  to  move  the  smoother  boundary. 
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VI.  The  Smoothing  Error  for  TPBVDS’s 

Recall  from  the  development  in  Section  III  that  we  obtained  the  form  of 
the  optimal  smoother  by  expressing  x  and  X  in  terms  of  y  and  z  as  in  (3.10) 
and  then  setting  z  to  zero.  Thanks  to  the  orthogonality  of  z  and  y  we  can 
similarly  obtain  an  expression  for  the  smoothing  error  by  setting  z  to  zero  in 
(3.10): 


-3m'‘ 

X 

'mz 

X. 

““ 

.  0  , 

(6.1) 


where  x=x-x,  X=X-X.  If  we  then  use  these  relationships,  together  with 
(3.7),  (3.8)  we  obtain 


X 

0 

u 

y” 

yK 

L-xJ 

“ 

p 

.r. 

As  in  Section  III,  this  is  equivalent  to 


(6.2) 


^  ^ r 


■  x(k+l)' 

■  x(k)- 

B  0 

■u(k)' 

=  d 

+ 

-1 

L-x{k+i)J 

l-X(k)J 

[O  C'R  J 

.r(k). 

(6.3) 


with  boundary  conditions 
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-M1)J 


x(N) 

l-MN) 
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Bu(0) 
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-1 

^  ”2 

-1 

^0  ^b  ’'b. 

h  h  ^bj 

(6.4) 


Examining  (6.3),  (6.4),  we  see  that  the  evaluation  of  the  covariance  of 
the  estimation  error  x(k)  corresponds  to  the  computation  of  (the  upper 
left-hand  block  of)  the  covariance  of  the  TPBYES  (6.3),  (6.4)  driven  by  white 
noise  (u'(k),  r'(k))  and  with  independent  boundary  conditions.  In  the 
Appendix  we  describe  one  method  for  performii^  this  computation  for  the 
original  TPBVDS  introduced  in  Section  II.  This  calculation  is  somewhat  more 
complicated  than  the  corresponding  one  for  causal  systems  since  x(k)  in  (2.1) 
is  not  Jfeirkov  and  in  fact  is  not  independent  of  future  values  of  u(k).  We 
refer  the  reader  to  [25,31]  for  more  on  the  properties  and  calculation  of  the 
covariance  and  correlation  function  of  such  processes. 

We  close  this  section  with  two  final  observations.  First,  note  that  the 
computation  described  in  the  Appendix,  when  applied  to  (6.3),  (6.4)  yields  the 
covariance  of  x(k)  for  k  >  1.  In  order  to  compute  the  covariance  of  x(0) ,  we 
need  to  examine  the  counterpart  to  (3.22): 
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■  x(0)' 
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Bu(0) 
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.-MO). 

=  D  t 
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"'^21* 
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■  x(K)' 
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yS 

rH^). 

-X(K)_ 

(6.5) 
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The  calculation  of  the  covariance  of  the  left-hand  side  of  (6.5)  then  involves 
the  computation  of  the  covariances  of  and  the  correlations  among  the  various 
reindom  vectors  appearing  on  the  right-hand  side  of  (6.5).  An  analogous 
computation  is  also  carried  out  in  the  Appendix. 

The  second  point  concerns  the  diagonal izat ion  of  (6.2).  In  particular, 
assuming  that  positive  definite  solutions  exist  to  (4.11),  (4.12),  we  can 
perform  analogous  steps  to  those  used  in  Section  4.2  to  transform  (6.2)  into 
the  non-descriptor,  forward  and  backward  pair  of  equations 

T(k)  =  A*S"^E0~^T(k+l)  -  A’S~^Bu(k)  +  C’R"^r(k)  (6.6a) 

5{k+l)  =  AT"^E*'?“^6(k)  +  Bu(k)  +  AT“^*R~^r(k)  (6.6b) 

(with  corresponding,  and  generally  coupled,  boundary  conditions)  with  x(k)  and 
-X(k)  then  obtained  from  (4.23a.  b).  respectively,  with  t  auid  5  replaced  by  t 
and  5. 

Equation  (6.6)  is  extremely  useful.  In  the  first  place,  it  provides  the 
forward-backward  decomposition  needed  in  the  covariance  analysis  procedure 
described  in  the  Appendix.  More  importantly,  it  provides  the  basis  for  a 
system-theoretic  investigation  of  the  smoother,  several  elements  of  which  are 
briefly  described  in  the  next  section. 
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VII.  Discussion 

In  this  p>aper  we  have  investigated  the  optimal  estimation  problem  for 
two-p>olnt  boundary-value  descriptor  systems  (TPBVBS’s).  Using  the  method  of 
complementary  processes  we  developed  a  generalization  of  the  Hamiltonian  form 
of  the  optimal  smoother  for  causal  systems.  This  genrealized  Hamiltonian 
system  is  itself  a  TPBVDS.  In  addition,  we  have  generalized  the  notion  of 
Hamiltonian  diagonal ization  as  a  method  for  reducir®  the  smoother  to  two 
systems  of  lower  order.  Both  of  the  approaches  described  involve 
generalizations  of  standard  Riccati  equations.  One  of  these,  corresponding  to 
descriptor  Riccati  equations  that  have  appeared  in  the  literature,  is  shown  to 
work  only  in  certain  cases  and  is  not  appropriate  when  the  system  dynamics  are 
intrinsically  acausal,  l.e.  when  both  system  matrices  E  and  A  are  singular. 

However,  our  second  approach,  involving  what  we  call  generalized  Riccati 
equations,  appears  to  offer  much  promise.  Indeed  we  have  illustrated  that  it 
does  provide  a  viable  approach  in  the  acausal  case.  Furthermore,  in  a 
forthcoming  p>aper  [33]  we  present  results  that  make  clear  many  of  the 
system-theoretic  properties  of  these  new  Riccatl-like  equations  and  the 
associated  generalized  Hamiltonian  system.  In  particular  in  [25,29,30]  we 
introduce  and  analyze  the  properties  of  weak  and  strong  reachability  for 
TPBVDS’ s,  and  in  [33]  we  show  that  strong  reachability  and  observability 
guarantee  the  existence  of  unique  positive  definite  solutions  to  (4.14), 

(4.15)  and  the  forward-backward  stability  of  the  smoother.  Also,  in  [31]  we 
investigate  a  more  meaningful  notion  of  stability  for  TPBVDS’ s  as  well  as  the 
existence  of  stationary  statistics  for  such  systems.  In  [33]  we  show  that 
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strong  reachability  and  observability  guarantee  that  the  smoother  is  stable  in 
this  sense  and  we  also  use  the  machinery  of  [31]  to  relate  the  solutions  of 
(4.14),  (4.15)  to  the  asymptotic  error  covariance.  Also,  as  one  might  expect, 
additional  results  can  be  obtained  relating  smoother  stability  to  notions  of 
detectability  and  stabilizabllity.  and  a  generalized  Hamiltonian  eigenvector 
approach  can  be  developed  to  solve  (4. 14) .  (4. 15)  in  a  manner  analogous  to  the 
popular  method  for  standard  Riccati  equations  [27.28] 
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Appendix:  Covariance  Analysis  for  TPBVDS’s 

In  this  appendix  we  develop  formulas  for  covariance  analysis  of  TPBVDS's. 
As  a  starting  point  for  this  computation,  we  assume  that  our  TPBVDS  has  been 
placed  in  the  forward-backward  form  given  in  (2.9),  (2.11).  The  general 
solution  for  this  system  is  given  in  (2.16).  Given  the  independence  of  the 
boundary  value  v  and  the  white  sequence  u(k) ,  we  see  that  the  covariance  of 
x{k)  can  be  expressed  in  terms  of  the  covariance,  IT^,  of  v  and  the  three 
quantities 


P^°(k)  =  ECXf°{k)x^°{k)’] 

(B.la) 

P^°(k)  =  E[x^°(k)x^°(k)-] 

(B.lb) 

Pfb°(n.k)  =  E[xj®(n)x^^®(k)  '  ] 

(B.lc) 

The  computations  of  these  quantities 

are  straightforward: 

P^°(k+1)  =  A^Pj°(k)A^’  +  B^QB^' 

o 

II 

o 

o 

(B.2a) 

Pb°{K)  =  0 

(B.2b) 

and 

0 

,  n  <  k 

P,^“(n.k)  = 

Af*^"^fb°(k)  ,  n  >  k 

(B.2c) 

where 

2I^^°(k+l)  =  A^II^^°{k)A^'  +  B^QB^-  =  0 

Given  these  quantities,  we  can  now  determine  an  expression  for 


Xf(k) 


5(k)  =  E  { 


[x^,(k)J 


[x^-{k),  x^'{k)]} 


(B.3) 


41 


As  mentioned  in  Section  6,  the  computation  of  the  error  covariance  at  the 
initial  point  in  the  interval  of  interest  involves  an  additional  computation. 
In  the  remainder  of  this  Appendix  we  describe  the  corresponding  calculation 
for  (2.9),  (2.11).  Specifically,  suppose  we  would  like  to  compute  the 
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covariance  of 


x.{0)  x»(K) 

T)  =  N,f  + 

1  ^  Xj^(O)  x^(K) 


(B.8) 


where  f  is  a  zero-mean  random  vector  correlated  with  the  boundary  condition  v 
but  independent  of  u.  Let 


E[ff']=P^  E[fv-]=P^^  ECTm’]=P^ 


(B.9) 


Then,  with  the  help  of  (2.16)  we  have 


=  N,P_N.  ' 
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Pf(0) 
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No' 

+  N., 

Pf(K) 
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1  f  1 
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Pb(0) 
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3 

0 

Pb(K) 

+  NjP^^G'(0)N2*  +  N2G(0)P^^-N^-  +  N^P^^G ’ {K)N3 ’ 
+  N3G{K)P^^-N^'  +  N2P’{K.0)N3’  +  N3P(K.0)N2* 


(B.IO) 


where 


Xf(n) 


P{n.k)=E{p  [x^-(k)  x^’(k)]}  .n>k 


(B.ll) 


can  be  calculated  in  the  same  manner  as  2(k) : 


P{n.k)  =  G{n)ir^G'(k)  +  G(n)4'{k)  +  \f''(n)G‘(k) 
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+  G(n)AG'(k)  + 


"-^P^O(k) 


0 


0 


(B.12) 
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